Overcoming Communication Restrictions in Collectives
نویسنده
چکیده
Many large distributed system are characterized by having a large number of components (eg., agents, neurons) whose actions and interactions determine a %orld utility” which rates the performance of the overall system. Such “collectives” are often subject to communication restrictions, making it difiicult for components which tzy to optimize their own “private” utilities, to take actions that also help optimize the world utility. In this article we address that coordination problem and derive four utility functions which present different compromises between how “aligned” a component’s private utility is with the world utility and how readily that component can determine the actions that optimize its utility. The results show that the utility functions specifically derived to operate under communication restrictions outperform both traditional methods and previous collectivebased methods by up to 75%.
منابع مشابه
Virtualizing Communication for Hybrid and Diversity-Aware Collective Adaptive Systems
Hybrid and Diversity-Aware Collective Adaptive Systems (HDA-CAS) form a broad class of highly distributed systems comprising a number of heterogeneous human-based and machine-based computing (service) units. These units collaborate in ad-hoc formed, dynamicallyadaptive collectives. The flexibility of these collectives makes them suitable for processing elaborate tasks, but at the same time, bui...
متن کاملEvaluation of Optimized Barrier Algorithms for SCI Networks with Different MPI Implementations
The SCI Collectives Library is a new software package which implements optimized collective communication operations on SCI networks. It is designed to be coupled to different higher-level communication libraries (especially MPI implementations) by adapter modules, thereby giving them access to these optimized collectives. In this work, we present the design of the SCI Collectives Library and o...
متن کاملMPI collectives at scale
Collective operations improve the performance and reduce code complexity of many applications parallelized with the messagepassing interface (MPI) paradigm. In this article, we will investigate the impact of load imbalance on the performance of collective operations and possibility for hiding parallel overhead caused by a collective communication pattern, by overlapping the communication with c...
متن کاملBiological Memories and Agents as Quantum Collectives
Quantum mechanical models have been proposed for biological processes and for cognition and decision in domains that appear to be beyond the de Broglie wavelength. The basis of such quantum behavior is seen variously as quantum fields and virtual and entangled particles, and the determination that the behavior is quantum is made on coherence, order and interference effects, and non‐local behavi...
متن کاملUPC Collectives Library 2.0
Collective communication has been a part of the UPC standard since having been introduced in 2005 with the UPC Specification version 1.2. However, unlike MPI collectives, UPC collectives have never caught on and are rarely used. In this paper we identify and discuss several fundamental limitations and important missing features in the design of the existing UPC collectives that make them inconv...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2004